I hereby agree to the terms of the CLA available at: https://docs.databend.com/dev/policies/cla/

Summary

fix: improve error handling in history table

As a logging service, the history table should avoid exiting on recoverable errors. For issues such as storage being full or temporary network problems with storage, the system should keep retrying until the external service is healthy again.

fix: COPY INTO should with MAX_FILES copy option

If a lot of intermediate logging files stored in stage, the COPY INTO operation should enable a MAX_FILES option to avoid error: Commit limit reached: 15,000 files for 'copy into table'

Tests

• Unit Test
• Logic Test
• Benchmark Test
• No Test - Explain why

Type of change

• Bug Fix (non-breaking change which fixes an issue)
• New Feature (non-breaking change which adds functionality)
• Breaking Change (fix or feature that could cause existing functionality not to work as expected)
• Documentation Update
• Refactoring
• Performance Improvement
• Other (please describe):

This change is